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Abstract 

This paper studies the problem of interference channels with one cognitive transmitter (ICOCT) 
where "cognitive" is defined from both the noncausal and causal perspectives. For the noncausal ICOCT, 
referred to as interference channels with degraded message sets (IC-DMS), we propose a new achievable 
rate region that generalizes existing achievable rate regions for IC-DMS. In the absence of the non- 
cognitive transmitter, the proposed region coincides with Marton's region for the broadcast channel. 
Based on this result, the capacity region of a class of semi-deterministic IC-DMS is established. For 
the causal ICOCT, due to the complexity of the channel model, we focus primarily on the cognitive 
Z interference channel (ZIC), where the interference link from the cognitive transmitter to the primary 
receiver is assumed to be absent due to practical design considerations. Capacity bounds for such 
channels in different parameter regimes are obtained and the impact of such causal cognitive ability 
is carefully studied. In particular, depending on the channel parameters, the cognitive link may not be 
useful in terms of enlarging the capacity region. An optimal corner point of the capacity region is also 
established for the cognitive ZIC for a certain parameter regime. 

I. Introduction 

Cognitive radios have been proposed as an enabling technology to address the spectrum 
scarcity issue. Cognitive radios are capable of sensing their environment and adjusting their 
parameters and transmission modes in real time. Therefore, they can adaptively fill the under- 
utilized spaces of the wireless spectrum and greatly increase the overall spectral efficiency. 

There have been recent attempts in studying the cognitive radio channel from an information 
theoretic point of view [l]-[4]. There, a cognitive radio channel is modeled as a two-user 
interference channel. One of the transmitters, the so-called cognitive transmitter, has non-causal 
knowledge of the other user's transmitted messages (see Fig. [D, which is why this model is also 
referred to as interference channels with degraded message sets (IC-DMS). In [1], the authors 
combined Gelfand and Pinsker's coding [5] with Han and Kobayashi's simultaneous superposition 
code [6] to derive an achievable rate region for the general IC-DMS. In [2] and [3], the authors 
derived the capacity region for IC-DMS with weak interference. In [4], the capacity region for 
IC-DMS with strong interference was determined. Those results were extended to the Gaussian 
MIMO cognitive radio channels in [7]. 

Recently, more general coding schemes were proposed in [8] and [9], which include the results 
in [2] and [3] as special cases. In [8], the cognitive encoder uses rate splitting and allows the 
other receiver to decode part of the interference; the cognitive transmitter also cooperates by 
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transmitting the other user's message, and uses the Gel'fand and Pinsker (GP) binning to cancel 
this known interference at its intended receiver. A similar approach was proposed independently 
in [9] with the difference that they introduced the superposition coding into their binning process, 
thus yielding improvement upon [8]. 

The IC-DMS model is interesting in the sense that it combines the features of both interference 
channel and broadcast channel. Specifically, if the cognitive user is deprived of the knowledge 
about the other user's messages, it reduces to the classic interference channel; if the primary, 
i.e., non-cognitive user is absent from the channel model, it reduces to the general broadcast 
channel. However, the achievable rate regions proposed in [8] and [9] do not reduce to Marton's 
region [10] for general broadcast channels, implying potential improvements are possible for 
the coding strategy. Notice that this situation is relevant in practice if the channel from the 
cognitive transmitter to the primary receiver is superior compared with that from the primary 
(non-cognitive) transmitter. Thus it is desirable to let the cognitive transmitter take over the 
primary transmitter's responsibility instead of merely serve as a cooperative transmitter. In this 
work, we propose an achievable rate region for IC-DMS that generalizes the coding schemes 
in [8], [9] and can also reduce to Marton's region. The proposed new achievable region helps 
establish the capacity region of a class of semi-deterministic IC-DMS. 

While the non-causal ICOCT, i.e., IC-DMS, has been extensively studied, the causal ICOCT 
has been far less investigated. In the causal scenario, the cognitive transmitter adapts its transmis- 
sion based on the causally received signals transmitted by the primary transmitter. This causal 
cognitive radio model, while more relevant and practical compared with the non-causal case, is 
considerably more complex than the latter because of the noisy feedback involved in the channel 
model. We remark that the causal ICOCT is itself a special case of an even more complex model, 
the so-called interference channels with generalized feedback (ICGF) in which both transmitters 
are causally cognitive. Two different achievable rate regions for ICGF were proposed in [11] and 
[12] respectively, using drastically different coding schemes. Interestingly, neither of these two 
regions includes the other as a subset for the general ICGF model, although for several extreme 
cases, the region proposed in [12] is shown to coincide with the capacity region. 

For the causal cognitive radio channel, we focus on the Gaussian case and our causal ICOCT 
can be considered as a simplification of ICGF, by taking away the cognitive capability from 
one of the transmitters. Nonetheless, even with a single channel feedback, the problem is still 
of formidable nature. In [13], the authors imposed a degradedness assumption which leads to 
closed-form and relatively simple capacity inner and outer bounds. In the present work, we will 
instead focus on a more practical model, the so-called cognitive ZIC for the Gaussian case where 
the causal ICOCT is further simplified by taking away the interference link from the cognitive 
transmitter to the primary receiver. This Gaussian cognitive ZIC is illustrated in Fig. [3] This 
simplified model is largely motivated by many proposed cognitive radio schemes that require 
the so-called 'interference temperature' at the primary receiver to be sufficiently low. Thus the 
ZIC considered in this paper can be considered as an approximation to such cognitive radio 
channels where the interference imposed on the primary receiver by the cognitive transmitter 
is largely negligible. For the cognitive ZIC, capacity inner and outer bounds are proposed for 
various parameter regimes and we demonstrate that the cognitive link may not be helpful for 
certain parameter regimes, as far as the capacity region is concerned. A corner point on the 
capacity region is also established for a certain parameter regime. 

This paper is organized as follows. In Section II, we consider noncausal ICOCT and propose a 
new achievable rate region for IC-DMS that generalizes existing results. The proposed region re- 
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duces to Marton's region [10] in the absence of the primary transmitter. The proposed achievable 
region also allows us to establish the capacity region for a class of semi-deterministic channels. 
In Section III, we consider the causal cognitive ZIC. We propose several inner bounds to the 
capacity region for different values of channel parameters. We also introduce an outer bound 
to the capacity region which, together with the inner bounds, allows us to identify a capacity 
region corner point as well as parameter regimes for which the cognitive capability does not 
enlarge the capacity region. The concluding remarks are given in Section IV. 

II. NONCAUSAL ICOCT 

A. Channel Model 

A noncausal ICOCT (or IC-DMS), is a quintuple (Xi, X 2 ,p, 3^i> 3^), where Xi,X 2 are two 
finite input alphabet sets and 3^i, 3^2 are two finite output alphabet sets, p is the channel transition 
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Fig. 1. Noncausal ICOCT model. 



probability p(yi,y 2 \xi,x 2 ). We assume that the channels are memoryless, i.e. 

n 

P n (yi,y2|xi,x 2 ) = Y[p(yii,y2i\xii,x2i) 



where 



(x al , ■ ■ •, x an ) e y a = (y al , ■ ■ y an ) E 



(1) 



(2) 



for a = 1,2. Let Mi = {1,2,- • -,Mi} and M 2 = {1,2,- • -,M 2 } be the message sets that 
sender 1 (primary transmitter) and sender 2 (cognitive transmitter) will transmit, respectively. The 
cognitive transmitter has noncausal knowledge of user l's message, so there are Mi codewords 
for Xi(i) and M 1 ■ M 2 codewords for ic 2 (i,j). 

Definition 1: An (Mi, M 2 ,n, P e ) code exists for the IC-DMS, if and only if there exist two 
encoding functions 

fi : Mi - A?, f 2 :MixM 2 ^ X™ 
and two decoding functions 

gx-W^Mu g2-.y%^M 2 , 



October 4, 2009 



DRAFT 



4 



such that max{Pg"\ P e2 } < P e , where P^f and P^ deonte the respective average probabilties 
of error at decoders 1 and 2, and are computed as 

, Mi M 2 

PS ^mmEE^^^W^^^')) (3) 

1 Mi M 2 

p # = Mir EE p (^ ^ (4) 

1 2 i=l j=l 

where rh\ and m 2 are the decoded message index at receiver 1 and 2 respectively. 

Definition 2: A non-negative rate pair (Ri, R 2 ) is achievable for the IC-DMS, if for any given 
< P e < 1 and sufficiently large n, there exists a (2 nRl , 2 nR2 , n, P e ) code for the channel. The 
capacity region of IC-DMS is the closure of the union of all the achievable rate pairs (R±, R 2 ). 

B. Existing Results 

The capacity region for IC-DMS with strong interference was characterized in [4] and repeated 
in Proposition [TJ 

Proposition 1: [4, Theorem 1] For an IC-DMS satisfying: 

7(X 2 ;y 2 |X 1 ) < I(X 2 ;Y 1 \X 1 ) (5) 
I(X 1 ,X 2 ;Y 1 ) < I(X U X 2 ;Y 2 ) (6) 

for all joint distributions on X\ and X 2 , the capacity region C is the union of all rate pairs 
(Ri, R 2 ) satisfying 

R2 < I{X 2 -Y 2 \Xx) (7) 

R1 + R2 < J(X 1 ,X 2 ;F 1 ) (8) 

over joint distributions p(x%, x 2 )p(yi, y 2 \xi,x 2 ). 

The capacity rate region for IC-DMS with weak interference was found in [2] and [3] as in 
Proposition |2l 

Proposition 2: [2, Theorem 3.4] The capacity region for IC-DMS with weak interference is 
the convex hull of all rate pairs (Rx,R 2 ) satisfying: 

Ri < HU,X 1 ;Y 1 ) (9) 

R2 < I(X 2 ;y 2 |l7,Xi) (10) 

over all probability distributions that factor as p(u,Xi)p(x 2 \u,xi)p(yi,y 2 \xi,x 2 ), with the as- 
sumption that 

/(X^Yl) < I(X 1 ;Y 2 ) (11) 

I^YxlXx) < /([/;y 2 |X0 (12) 
In the same paper [2], Wu et al also proposed an achievable region for the general IC-DMS, 
given in Proposition [3] 

Proposition 3: [2, Proposition 3.1] The convex hull of all rate pairs (Ri, R 2 ) satisfying 

Ri < I&XnY,) (13) 
R2 < I(V;Y 2 )-I(V;U,X 1 ) (14) 
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over all probability distributions p(xi, x 2 , u, v, yi, y 2 ) that factor as 

p(u, x{)p(v\u, x 1 )p(x 2 \v, u, x 1 )p{y 1 , y 2 \x 1 , x 2 ) (15) 

is achievable for general IC-DMS. 

More recently, Jiang and Xin proposed a general achievable rate region [8] for IC-DMS, 
denoted by IZjx, which includes the region proposed in [2] and [3] as special cases. In order to 
better compare this result with our proposed region, we provide in Proposition |4] the expressions 
directly derived from the error probability analysis, i.e., before the Fourier-Motzkin elimination. 

Proposition 4: The rates R±, R 2 = R 22 + -R20 are achievable if 



Ri 


< 


I(W;Y 1 U\Q) 


(16) 


Ri + R20 


< 


I(WU;Y X \Q) 


(17) 


R20 


< 


I(U;Y 2 V\Q)-I(U;W\Q) 


(18) 


R22 


< 


I(V;Y 2 U\Q)-I(V;W\Q) 


(19) 


R20 + R22 


< 


I(UV; Y 2 \Q) + I(U; V\Q) - I(U; W\Q) - I(V; W\Q) 


(20) 



for some joint distribution that factors as 

p(q)p(w, xi\q)p(u\w, q)p(v\w, q)p(x 2 \u, v, w, q)p(yi, y 2 \xx,x 2 ) (21) 

and for which all the right-hand sides are nonnegative. 

Marie et al independently proposed an achievable rate region for the IC-DMS [9], denoted 
by TImgks which is given below. 

Proposition 5: [9, Theorem 1] Rates -Ri = R la + Ru, R 2 = R 2a + R 2c are achievable if 



R l < I(X la ,X lb] Y 1 ,U 2c \Q) (22) 

R1 + R2C < I{X la ,X lh ,U 2c -Y 1 \Q) (23) 

Rib < I(X lb ;Y 1 ,U 2c \X la ,Q) (24) 

Rib + R 2c < IiX^U^-Y^X^Q) (25) 

R2a < I(U 2a ;Y 2 \U 2c ,Q)-I(U 2a ,X la ,X lb \U 2c ,Q) (26) 

R2 < I(U 2c ,U 2a ;Y 2 \Q)-I(U 2c ,U 2a ,X la ,X lb \Q) (27) 

for some joint distribution that factors as 

p(q)p(xia, x u , u 2c , u 2a , Xx, x 2 \q)p(yx, y 2 \xx, x 2 ) (28) 
and for which all the right-hand sides are nonnegative. 



For the codebook generation, [9] did rate splitting for both messages mi and m 2 . Although 
m 2 is split into private message m 2a and common message m 2c , the sub-messages from mi are 
both private messages, namely m\ a and m\ b . Also, for the Gel'fand and Pinsker binning, both 
m 2a and m 2c are encoded treating both m\ a and m\ b as known interference. In other words, for 
the binning part, m\ a and m\ b are treated as one interference. Indeed, the same rate region as 
that in [9] can be obtained without rate splitting for the primary user. 
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Without rate splitting for m x , and using otherwise the same encoding scheme and following 
similar error analysis, one will get the achievable region as follows, denoted by 1Z MGKS 



Ri < I(W;Y x ,U 2c \Q) (29) 

R1 + R2C < I(W,U 2c ;Y x \Q) (30) 

R2a < I(U 2a ;Y 2 \U 2c ,Q)-I(U 2a ;W\U 2c ,Q) (31) 

R2 < I(U 2c ,U 2a ;Y 2 \Q) - I{U 2c ,U 2a -W\Q) (32) 
for some joint distribution that factors as 

p{q)p(w, u 2c , u 2a , x x , x 2 \q)p(yi, y 2 \x x , x 2 ) (33) 



and for which all the right-hand sides are nonnegative, where R 2 = R 2a + R2c- We now show 
that the two regions, namely IZmgks and TZ M gks are identical. 

First, for the region 1Z MGKS , if we set W = (X Xa ,X Xb ), we can get the same expressions of 
(|22)) -([2~3l) and (|26l) -d27T). with the same joint probability distribution. Since region IZmgks has 
two more constraints (|24)) -(l2~5l). IZmgks Q T^mgks- O n the other hand, for the region IZmgks, 
if we set Xy = <p and X la = W, IZmgks is reduced to 1Z' MGKS , so 1Z MGKS C IZmgks- 
Therefore, 1Z MGKS = TZmgks- 

Marton in 1979 considered the general broadcast channel model and proposed the following 
achievable rate region [10] which remains the largest to this date. 

Proposition 6: [10, Theorem 2] Let 1Z M be the union of rate pairs (R x , R 2 ) satisfying 
Ri,R 2 > and 

#i</(W i; n) (34) 
R 2 < I{WV 2 ; Y 2 ) (35) 
R! + R 2 < mm{I(W; Y x \ I(W; Y 2 )} + I(V X ; Y X \W) 

+I(V 2 ;Y 2 \W) - I(V X ;V 2 \W) (36) 

for some (Vi,V2,W) - > X — > (Y X ,Y 2 ). Then 1Z M is achievable for the discrete memoryless 
broadcast channel. 



C. A New Inner Bound 

Both [8] and [9] applied the following techniques: 

1) Rate splitting R 2 by dividing the message m 2 into m 22 and m 2 Q. Thus, the rate R\ will be 
boosted by letting m 20 be decoded at receiver 1 which reduces the effective interference. 

2) GP binning m 2 against m x so that this known interference will be cancelled at receiver 2, 
boosting the rate R 2 . 

3) User 2 (cognitive transmitter) cooperates with user 1 by transmitting message m x . 
However, both [8] and [9] do not have any part of mi decoded at receiver 2. While the 

coding scheme in [9] does involve rate splitting for m x , the two split messages, m Xa and m X \, 
in [9], are both private messages and not to be decoded at receiver 2. This suggests potential 
for improvement since GP binning is not always optimal, i.e., interference cancellation at the 
receiver 2 may outperform that at the transmitter 2 by GP binning only. For example, as observed 
in [9], when binning against a codebook, superposition coding is optimal over GP binning when 
the interference rate is small [9]. Therefore, the proposed coding scheme further divides m x 
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into private message m n and common message m 10 and superposition encodes m u on top of 
m w . Additionally, since m w is to be completely decoded by receiver 2, binning m 2 against m 10 
provides no improvements, thus, we only bin against mn. 

A second observation is that the coding schemes in [8] and [9] let transmitter 2 help with 
rate 1 through coherent transmission of the noncausally known message to receiver 1. However, 
if the direct link from transmitter 1 to receiver 1 is much weaker compared with that of the 
interference link from transmitter 2 to receiver 1, directly transmitting m u from transmitter 2 
may be suboptimal. In the extreme case when transmitter 1 is effectively silent (due, for example 
to channel conditions), transmitter 2 will serve as a transmitter for a two user broadcast channel 
for which cross binning (e.g., Marton's coding scheme) yields the largest achievable rates. As 
such, the proposed coding scheme introduces cross binning reminiscent that for the broadcast 
channel [14]. 

The above ideas lead us to Theorem \T\ which gives a new achievable rate region for IC-DMS. 

Theorem 1: The rate pair (Ri, R 2 ) is achievable for IC-DMS, if 

Ri < HVnUnVxUniY!) (37) 
R 2 < I(V 22 V 20 ;Y 2 \U 10 )-I(V 22 V 2 o;U 11 \U 1 o) (38) 
R1 + R2 < I(V 11 Un;Y 1 \V 20 U 10 ) + I(V 2 2V 20 U w ;Y 2 ) 

-I(V U ; V 22 \V 20 U W ) - I(U n ; VnlVnVnUw) (39) 
R1 + R2 < nVnUnVwU^Y^ + IiV^Y^VwUw) 

-I(V U ; V 22 \V 20 U W ) - I(U U ; VnlVnVwUu)) (40) 
2R 2 + R, < I(ViitfiiF 20 ;n|^io)+/(^2; Y 2 \V W U 10 ) + I(V 22 V 20 U 10 ;Y 2 ) 

-I(V U ; V 22 \V 20 U W ) - I(U n ; V^VnVMo) - I(V 22 V 20 ; U n \U 10 ) (41) 
for some joint distribution that factors as 

p(uio, v n , w 20 , v 22 , xi, x 2 )p(y 1 , y 2 \x!, x 2 ) (42) 
and for which all the right-hand sides are nonnegative. 

The above theorem is a direct consequence of applying the Fourier-Motzkin elimination to the 
following rate region. 

Theorem 2: Rates R\ = Rn + Rio and R 2 = R 22 + R 20 are achievable if 

R20 < L 20 -/(F 2 o;£/ii|£/io) (43) 

Ru < Ln-UVnlUnWnUu) (44) 

#22 < L 22 -I(V 22 ;U n \V 20 U 10 ) (45) 

R11 + R22 < L n + L 22 -I(V n ;V 22 \V 20 U 1 o)-I(U 11 ;V 11 V 22 \V 20 U 10 ) (46) 

L n < nVnUn^lV^U^+IiVnV^UnlUw) (47) 

^11 + ^20 < nVnUnV^Y^U^+IiVnV^UnlUw) (48) 

L u + £20 + ^0 < I(ViiC/iiV 2 o[/io;r 1 )+/(y 11 F 20 ;C/ii|[/io) (49) 

^22 < I(V 22 ;Y 2 \V 20 U 10 ) (50) 

L22 + L 2 Q < I(V 22 V 20 ;Y 2 \U 10 ) (51) 
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L 22 + L 20 + Rio < ^(^22^20^10! Y 2 ) 
for some joint distribution that factors as 

£>0io, ^11,^20, ^22, x 1 ,x 2 )p{yi, yzlxi, x 2 ) 

and for which all the right-hand sides are nonnegative. 
Proof: See Appendix. 
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Fig. 2. Diagram of the encoding schemes, (a) Encoder 1 (b) Encoder 2 
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The encoding scheme is illustrated in Fig. [2l Both encoders apply rate splitting to their 
respective messages. Encoder 1 encodes the two sub-messages using superposition coding. 
Encoder 2, i.e., the cognitive transmitter's encoding process is much more complex. It involves 
Gel'fand and Pinsker binning for the generation of v 20 , and the cross binning for the generation 
of and v 22 , as used in the general broadcast channel. Specifically, encoder 2 first encodes 
message W 2 $ into codeword v 20 superimposed on u™ and applies Gel'fand and Pinsker binning 
against u^. Then, on top of codeword pair (wi , ^2o)> ^ generates t>]\ for message Wu and v 22 
for message W 22 and applies cross binning against each other. Encoder 2 also cooperates with 
the primary transmitter by transmitting codewords and w" . 

The achievable rate region in Theorem [2l denoted by 71*, is derived based on simultaneous 
decoding. In Theorem |3l we introduce another region 7Z based on sequential decoding, which 
is a subset of TV. 
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Theorem 3: Rates R\ = Rn + Rio and R 2 = R22 + R20 are achievable if 

R20 < L 20 -I(V 20 ;U n \U 10 ) (54) 

Rn < L 11 -I(V 11 ;U 11 \V 20 U 10 ) (55) 

R22 < L 22 -I(V 22 ;Un\V 20 U 10 ) (56) 

R11 + R22 < L n + L 22 -I(V n ;V 22 \V 20 U 10 )-I(U n ;V n V 22 \V 20 U lo ) (57) 

L 20 < mmUiV^Y^U^JiV^Y^Uw)} (58) 

#10 + ^20 < mm{I(V 2Q U 1Q ;Y 1 ),I(V 20 U 10 ;Y 2 )} (59) 

L n < I(V n Un]Y 1 \V 20 U w )+I{VuV 20 ]Un\Um) (60) 

£22 < I(V 22 ;Y 2 \V 20 U 10 ) (61) 

for some joint distribution that factors as 

p(u 10 , un, v u ,v 20 , v 22 , xi,x 2 )p(y 1 , y 2 \x u x 2 ) (62) 
and for which all the right-hand sides are nonnegative. 



Proof: The encoding scheme is the same as that in Theorem [2l which leads to (l54l)- (|57l) . 
The decoders first decode messages m 20 and mio using simultaneous decoding, which leads to 
(I58l)-(l59l). After subtracting out the signals decoded in the first stage, decoder 1 proceeds to 
decode m n and decoder 2 proceeds to decode m 22 , which leads to (l60l)- ((6"TT) . ■ 

Both the above two regions 1Z* and 1Z are convex. Therefore, no convex hull operation or 
time sharing is necessary. The convexity of the regions can be easily proved following the same 
approach as in [15, Lemma 5]. 

D. Special Cases 

1) Strong interference: In the case of strong interference, the optimal scheme is for both 
user's messages to be decoded by both receivers. Thus, by setting Vn = V 22 = Un = <p and 
Ri = -Rio, R2 = R20, TZ* reduces to the capacity region for IC-DMS with strong interference in 
Proposition [TJ 

2) Weak interference: By setting V n = V 20 = U n = <fi, V 22 = X 2 , U w = (U,Xi) and 
Ri = Rio, R 2 = R 22 , and removing all the redundant conditions based on the assumption 
(fTTI)-([T2l). TV reduces to the capacity region for IC-DMS with weak interference in Proposition 

HI 

3) The rate region in [2]: By setting V 20 = U w = Vn = <fi, Un = (U,Xi), V 22 = V and 
Ri = R n = L n and R 2 = R 22 , TV reduces to Wu et a/'s achievable rate region for the general 
IC-DMS in Proposition B 
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4) The rate region in [1 ]: Our scheme in Theorem [2] is similar to the coding scheme proposed 
in [1] in the sense that, both users' messages are divided into two parts: private message decoded 
only by the intended receivers, and common message decoded by both receivers. However, our 
scheme is different from that in [1] in the following ways. 

• User 2's codewords v 2 2 and v 2 o are binned against u n only, while in [1], v 22 and v 20 
are binned against both uu and ui . Since ui is to be completely decoded by receiver 1, 
binning against u 10 provides no improvement. 

• The binning of v 22 and v 20 in [1] is done independently, whereas we add dependency 
between them to provide potential improvements. 

• In our scheme, the cognitive transmitter will cooperate with the primary user by transmitting 
the primary user's messages, whereas there is no cooperation between the two users in [1]. 

• The coding scheme in [1] does not have the codeword vn as in our scheme. The function 
of Vii is to potentially cancel out the interference from the message m 22 at receiver 1, thus 
boosting the rate Rn. 

After applying the Fourier Motzkin elimination, for fixed joint distribution of those random 
variables, the polygon of TV has constraints for four different slopes, namely, R\, R 2 , R\ + R 2 
and 2R 2 + R lf while the polygon of the region in [1] has one more slope constraint 2R 1 + R 2 . 
For fixed joint distribution, it turns out that the the bound for the slope 2_R 2 + R\ of the region 
in [1] can be larger than that of TV, while the rest of the bounds are smaller than TV . As such, 
it is not easy to establish a subset relation between these two regions analytically. 

5) Jiang and Xin's region: Jiang and Xin's region TZjx is different from TV in that 

• there is no rate splitting for K\\ 

• the binning of v 22 and v 20 are done independently; 

• there is no codeword vn. 

After setting U 10 = Q, U n = W, V u = <p, V 20 = U, V 22 = V, Ri = R n = L n , and substituting 
all the L 22 and L 20 using (l43l)-(l46l). TV reduces to a region, denoted by 1Z , with only the 



following two bounds different from TZjx- 

R22 < I(V;Y 2 \UQ)-I(V;W\UQ) (63) 

#22 + ^20 < I(UV;Y 2 \Q)-I(V;W\UQ)-I(U;W\Q) (64) 
The corresponding bounds in IZjx are 

R22 < I(V;Y 2 U\Q) - I{V;W\Q) (65) 

R20 < I(U;Y 2 V\Q) - I(U;W\Q) (66) 

#22 + ^20 < I(UV;Y 2 \Q) + I(U;V\Q)-I(V;W\Q)-I(U;W\Q) (67) 
According to the distribution (1271) . for any (V, U, W) in IZjx, we have 

H(V\UWQ) = H(V\WQ) (68) 



Now, we set the variables in Tl' as V* = (V,U),U* = U,W* = W. Due to d68i it can be 
easily checked that (1631 is equal to (1631) , and (|64l) is equal to (f6Tb . Therefore, 1Zj X Q TZ . Hence, 
TZjx C TV. 
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6) Marie et al's region: Marie et al's region is different from TZ* in that 

• no part of rri\ is decoded by receiver 2; 

• there is no codeword v n . 

By setting U 10 = Q, U n = (X la ,X lb ), V n = (f), V 22 = U 2a , V 20 = U 2c , R x = R n = L u and 
substituting all L 22 and L 20 by R 22 and R 20 using (|43l) -(l46l>. TZ* reduces to exactly (I2"2"l)-d2"3l 
and (f26b-(f27T). Thus, TZ* includes Marie et a/'s region as a subset. 

7) Marton's region: In the absence of transmitter 1, IC-DMS reduces to the general broadcast 
channel. However, the achievable rate regions proposed in [8] and [9] do not reduce to Marton's 
region [10]. This is due to the way binning is used in [8] and [10]: the binning is always in 
one direction, i.e., the primary user's message is always treated as known interference. The new 
ingredient in the present work is the use of cross binning which allows us to recover Marton's 
region for the broadcast channel. We now establish that TZ* includes Marton's achievable region 
as a subset in the absence of transmitter 1 . Toward that end, it will be convenient if we compare 
the region TZ described in Theorem [3] with Marton's region TZm- 

Setting Un = U 10 = <p, V 20 = W, Vn = V 1 , V 22 = V 2 and removing redundant constraints, 



the proposed region TZ becomes 

R20 < L 20 (69) 

R11 + R22 < L 11 + L 22 -I(V 1 ;V 2 \W) (70) 

Rio + L 20 < minU^lU J(W;Y 2 )} (71) 

Rn<L n < I(Vi',Yi\W) (72) 

R 22 <L 22 < I(V 2 ;Y 2 \W) (73) 

Applying the Fourier-Motzkin elimination on (I69l)-d73l) with the definition Ri = R u + R w and 

R 2 = R 22 + R 2Q , TZ becomes 

Ri < J(yi;Ki|W) + niin{/(W;Yi),/(W;Y 2 )} (74) 

R2 < I(V 2 ;Y 2 \W) + mm{I(W;Y 1 ),I(W;Y 2 )} (75) 



Rt + R 2 < mm{I{W;Y 1 )J(W-Y 2 )} + I(V 1 -,Y 1 \W) + I(V 2 -Y 2 \W)-I(V 1 -V 2 \W) (76) 

The equivalence of region (|74l-(|76l) and TZm was proved by Gel'fand and Pinsker in [16]. 
Thus, we have shown that TZ reduces to Marton's region TZm when user 1 is absent, i.e., when 
the IC-DMS reduces to a broadcast channel. Since TZ C TZ*, TZ* includes TZm as a subset. 

We now introduce an outer bound to the capacity region for the general IC-DMS. 

Theorem 4: An outer bound TZ a to the capacity region of IC-DMS is the union of all rate 
pairs (R 1 ,R 2 ) satisfying 

Rt < I(XiU;Yi), (77) 
R 2 < I(X 2 -Y 2 \Xi), (78) 
R1 + R2 < I(XiU;Yi) + I(X 2 ;Y 2 \XiU), (79) 
for some joint distribution that factors as 

p(u,Xi,x 2 )p(yi,y 2 \xi,x 2 ). (80) 
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Proof: We start with the rate for the cognitive user. 

nR 2 = H(W 2 ) = H(W 2 \W l X^) (81) 

= I(W 2 ;Y 2 n \W 1 X^) + H(W 2 \Y 2 n W 1 X^) (82) 

< I{W 2 -Y 2 n \W x Xl) +nei (83) 

n 

= Y,^ W ^ Y ^ W ^ Y t l )+ n ^ (84) 

i=i 

n 

< ^ # (Yai|X u ) - ^(YalWiWaX^- 1 ^) + ne 1 (85) 
i=i 

n 

= H(Y 2l \X lt ) - H{Y 2l \X u X 2i ) + ne x (86) 



i=i 

n 



= J2l(X 2i ;Y 2i \X li )+ne 1 (87) 
i=i 

where (18TI ) is from the independence of the messages, (1831 is from Fano's inequality, (|84l ) is from 
the chain rule for mutual information, (f85l ) is from conditioning does not increase entropy, (|86l ) 
is due to the Markov chain (WiW^^Y^Xg) — > XuX 2i — > Y" 2i as a result of the memoryless 
property of the channel. 

Define the random variable [/, = (Wi, Y{~ x , Y 2 n i+1 ), then we have, for the primary user, 

nRx = H(W 1 )<I(Wi;Y?)+ne 2 (88) 

n 

= J2l(W 1 ;Y li \Yt 1 )+ne 2 (89) 

i=i 

n 

< J2l(X li W 1 Yt 1 Y^ i+l ;Y H )+ne 2 (90) 



i=i 



= ^/(X H C/ i; y H )+ne 2 (91) 

i=l 

n(fli + i? 2 ) = ff(W x ) + H(W 2 |Wi) < /(Wi; Y?) + J(W 2 ; Y 2 n |Wi) + ne 3 (92) 

n 

= [HWi'i Y^t 1 ) + HW 2 ; Y 2i \WiY 2 n i+l )] + ne 3 (93) 



i=l 
n 



< [HXuW l Yt 1 ; Y u ) + I(W 2 ; Y^X^Y^)] + ne 3 (94) 

i=l 

n 

< Y [HXuW.Yl- 1 ; Y u ) + I{X 2l Yt l ; Y^X^Y^)] + ne 3 (95) 

i=l 
n 

= Y [HXuW^t'Y^, Y u ) - I(Y 2 n i+1 ; Y U \X U W X Y*) 

i=l 

+I{Yt 1 ; Y^XuWrY^) + I{X 2i ; Y^X^iY^Yt 1 )] + ne 3 (96) 
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i=l 

where (|94l) is due to the deterministic encoding at the primary user; (1951) is because conditioning 
reduces entropy and the memoryless channel assumption; (|97| ) is due to Csiszar's identity [15, 
Lemma 7]. Now, we introduce a time sharing random variable I that is independent of all other 
variables and uniformly distributed over {1, 2, n}. Define U = (£//, I), X\ = Xu, X 2 = X 2 i, 
Y 1 = Y u , Y 2 = Y 2I , then the Markov chain U -> (X x , X 2 ) — > (Y u Y 2 ) holds and we have 

n 

nR 2 < ^2l(X 2i ;Y 2i \X li )+ne 1 (98) 
i=i 

= nJ(X 2/; y 2J |X 1/ /)+ne 1 (99) 

= n[H{Y 21 \X ll I)-H{Y 2I \X 1I X 2I I)}+nt 1 (100) 

< n[H(Y 2I \X 1I )-H(Y 2I \X 1I X 2I )]+ne 1 (101) 
= nJ(X2j;y2j|Xij)+nei (102) 
= nI(X 2 ;Y 2 \X 1 )+ne 1 (103) 

n 

ni? a < ^2l(X 1 ^ i ;Y u )+ne 2 (104) 

8=1 

= nI(X lI U I -Y lI \I) + ne 2 (105) 

< nI{X 1I U I I\ Y u ) + ne 2 (106) 
= ^/(Xx^rO+nes (107) 

n 

n{R l + R 2 ) < Y^ I (XiiU i ;Y li )+I(W 2 ;Y 2i \X li U i )+ne 3 (108) 
i=i 

= n[/(I i; [/ 7 ; + I(X 2I ; Y^XnUiI)] + ne 3 (109) 

< n[I(X u UiI; Y u ) + I(X 2I ; Y^\X u UiI)] + ne 3 (110) 
= n[I(X 1 U;Y 1 ) + I(X 2 ;Y 2 \X 1 U)]+ne 3 (111) 



Semi-deterministic IC-DMS 

We can now consider the semi-deterministic IC-DMS with the deterministic component for 
receiver 2. More specifically, the received signal at receiver 2 is a deterministic function of the 
input signal X 1 and X 2 , i.e., Y 2 = h(Xi,X 2 ). In other words, the channel matrix from the input 
(Xi,X 2 ) to the output Y 2 has or 1 as its entries. 

For this semi-deterministic IC-DMS, if we impose an additional constraint I{X\;Yi) < 
I(Xi\Y 2 ), we are able to find the capacity region using the inner bound in Theorem Q] and 
the outer bound in Theorem as given in the following theorem. 
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Theorem 5: For a semi-deterministic IC-DMS, if I(X X ; Y x ) < I(X X ; Y 2 ) for any input distri- 
butions, the capacity region is the union of all rate pairs (R X ,R 2 ) satisfying 

Ri < I{X X U-Y X ) (112) 

R 2 < H{Y 2 \X 1 ) (113) 

R1 + R2 < I{X X U;Y X ) + H(Y 2 \X X U) (114) 

for some joint distributions that factor as 

p{u,x 1 ,x 2 )p(y 1 ,y 2 \x 1 ,x 2 ). (115) 
Proof: Converse: By definition, we have 

I(X 2 ; Y 2 \X 1 ) = H{Y 2 \X 1 ) (116) 
I(X 2 ;Y 2 \X X U)=H(Y 2 \X X U) (117) 

Plug (fTT6l)-(flT7l) into Theorem H we get ([TT2l) - ([TT4l) . 

Achievability: In the inequalities d37l>-(|4TT) in Theorem [H let U w = X l , V xx = U, V 22 = X 2 , 
U n = V 20 = <p. Then, ([37]) and ([38]) reduce to (TTT2T) - (fTT3l) directly. Also, (HI reduces to 

Ri + R2 < I{X X U; Fx) + I(X 2 ; Y 2 \X,) - I(U; X 2 \X X ). (118) 
Due to the Markov chain (11151) . 

I{X 2 \Y 2 \X X ) = H{Y 2 \X 1 )~H{Y 2 \X l X 2 ) (119) 

= H{Y 2 \X{) -H(Y 2 \X 1 X 2 U) (120) 

= I{Y 2l X 2 U\X x ) (121) 

= I(Y 2 ;U\X 1 ) + I(Y 2 ;X 2 \UX 1 ) (122) 
Also, due to the semi-deterministic channel, we have 

/(y a ;tf|XL) = H{U\X r ) - H{U\X X Y 2 ) (123) 

= H{U\X X ) - H{U\X X X 2 ) (124) 

= I(U;X 2 \X X ) (125) 
Combine (11221) and (11251) . (11181) becomes 

Ri + R 2 < I{X X U; Y x ) + I(X 2] Y 2 \X X U) = I{X X U; Y x ) + H(Y 2 \X X U), (126) 

hence (|114[) is achieved. Due to the additional constraint I(X X ;Y X ) < I(X X ;Y 2 ), £39]) and (HT) 
become redundant. This completes the proof for the achievability. ■ 
The capacity region in Theorem [5] indicates that for semi-deterministic IC-DMS with constraint 
I(X X ;Y X ) < I(X X ;Y 2 ), the optimal transmission scheme is for the primary user's messages 
m x to be decoded by both receivers while the cognitive user encodes m 2 on top of m x using 
superposition coding. 

III. The Cognitive ZIC 

In this section, we study ICOCT with causal cooperation. As explained in Section I, our focus 
will be on the special case of Gaussian ZIC where the interference link between the cognitive 
transmitter and the primary receiver is absent. 
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Fig. 3. The general model of the cognitive ZIC. 



A. Channel Model 

The (causal) cognitive ZIC is illustrated in Figj3] User 1 has message W\ G {1,2, ■ ■ -,2 nRl } 
to be transmitted to receiver 1 (Yj), and user 2 has message W 2 G {1, 2, ■ • •, 2 nR2 } for receiver 2 
(Y 3 ). In addition, user 2 can listen to the transmitted signal from user 1 through a noisy channel 
( Y 2 ). Thus, the channel model is given by 

Y[ = huX^ + Z^ (127) 

y 2 ' = /i 12 x; + z; (128) 
y 3 ' = /i 13 x; + /i 23 x; + z 3 (129) 

where h u , hi 2 , h 13 and /i 23 are fixed real positive numbers. Z x ' ~ iV(0, iVi), Z 2 ' ~ A^(0,A^ 2 ) 
and Z 3 ' ~ N(0, N 3 ) are independent Gaussian random variables. The average power constraints 
of the input signals are 

1 - 

-zZ^f< P 't d30) 

i=l 

where t = 1,2. From (11281) . we have assumed implicitly perfect echo cancellation. 

Lemma 1: Any cognitive ZIC described by (I127I) - (I129I ) is equivalent, in its capacity region, 
to the following cognitive ZIC in standard form 

Yi = X x + Z x (131) 
Y 2 = KX 1 + Z 2 (132) 
Y 3 = bX 1 +X 2 + Z 3 (133) 

where Z\, Z 2 and Z 3 are independent zero mean, unit variance Gaussian variables, and X\, X 2 
are subject to respective power constraints Pi and P 2 . K and b are deterministic real numbers 
with < K < oo, < b < oo. 

The proof is through a simple scaling transformation similar to that of [17], hence omitted. 
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Fig. 4. The standard model of the cognitive ZIC. 



The encoding functions f± and / 2 for users 1 and 2 are respectively: 

xi = MW,) (134) 

X2i = /2(W 2 ,J/21, • • -,y2,j-l) (135) 

for « = 1,2, • • -,n. We only consider deterministic encoders, as nondeterministic encoders do 
not enlarge the capacity region (See, e.g., [18, Appendix D]). 

B. Capacity Lower Bounds 

The cognitive ZIC includes the following two extreme cases: the classic ZIC (corresponding 
to K = 0) and the ZIC with degraded message sets (K = oo). To simplify our notation, we 
define 

7 (x)^log(l + x). (136) 

For the classic ZIC, when b > 1, the capacity region, denoted by IZx, is given below 

Ri < 7(A) =Ci (137) 
R 2 < 7(A) = C 2 (138) 
R1 + R2 < i(b 2 P 1 + P 2 ) (139) 

Apparently, IZi is an inner bound to the capacity region for the corresponding cognitive ZIC. 
When b < 1, we do not know the whole capacity region, but the sum rate capacity is known to 
be: 

Ri + R 2 < 7(A) + 7 (^75r) ( 14 °) 

which is achieved when user 1 is transmitting at its maximum rate, and user 2 is transmitting 
at a rate such that its message can be decoded at receiver 2 by treating user l's signal as noise. 



October 4, 2009 



DRAFT 



17 



On the other extreme, for the ZIC with degraded message sets, where user 2 has a priori 
knowledge of user l's message, the capacity region, denoted by 1Z 2 , is the following rectangle, 
for all b > 0: 

Ri < Ci (141) 
R 2 < C 2 (142) 

This is because for the Gaussian channel considered in this paper, user 2 can dirty paper code 
its own message treating user l's signal as known interference [19]. Therefore, this is equivalent 
to two parallel interference free channels. 1Z 2 serves as a natural outer bound to the capacity 
region of the cognitive ZIC. 

Little is known for the cognitive ZIC besides of the two extreme cases. The difficulty for 
the case with finite K is that it is not clear what is the optimal way to utilize the channel 
feedback at transmitter 2. Any information overheard through the cognitive link pertains only 
to message W\, yet, unlike the noncausal case described in Section II, the absence of link from 
X 2 to Y\ implies that existence of the cognitive link can not directly benefit the rate R\ through 
cooperative transmission. On the other hand, since Xi interferes receiver Y 3 , encoding schemes 
should explore the potential of facilitating interference cancellation for the secondary user using 
the cognitive link. In the following, we describe several cases where we can obtain closed form 
capacity bounds for the cognitive ZIC and discuss their implication in terms of the impact of 
the "cognitive capability" on the capacity. 

1) b 2 > 1 + P 2 : In the absence of the cognitive link, this reduces to the ZIC with very 
strong interference. The capacity region of such ZIC coincides with the outer bound 1Z 2 for the 
cognitive ZIC, suggesting that 1Z 2 is indeed the capacity region. Notice this is the case where 
there is no need to utilize the channel feedback Y 2 at user 2, as far as the capacity region is 
concerned. 

2) 1<6 2 <1 + P 2 : This is a very interesting case. In the absence of the cognitive link, 
the capacity region is the pentagon described by TZ\. On the other hand, for ZIC with degraded 
message sets, the capacity is a rectangle, 1Z 2 . The capacity region for the cognitive ZIC with 
1 < b 2 < 1 + P 2 should be between these two regions. We define another region 1Z 3 as the union 
of all nonnegative rate pairs (R± : R 2 ) such that: 

Ri < li^aPj (143) 
Ri < l(Pi) (144) 

Rl < 7 (**(« - m) + 7 ( 1 + 62(1 62 _^ Pi + P2 ) (145) 
R ^^-^^{ l + b 2 f% i + P 2 ) (146) 



R > * 7 I w/W (147) 

where < f3 < a < 1. 

Theorem 6: The the convex hull of the union of TZi and 1Z 3 is achievable for the cognitive 
ZIC. 

Proof: We only need to prove the achievability of 1Z 3 . User 1 splits the message W\ into 
two parts: the common message W\ 2 , which is to be decoded by all the receivers Yi, Y 2 and F 3 ; 



October 4, 2009 



DRAFT 



18 



the private message Wn, which is only to be decoded by receivers Y\ and Y 2 . User 1 randomly 
places the codewords of Wn into 2 nRo cells , indexed by Sn, and transmits Wn using the 
superposition block Markov encoding [20], as shown in Figj5l 



block 1 



<1) 



aP 1 



block 2 



(2) 



11 



aP l 



(1) 



sy 



aP l 



block B 



1 


1 


^11 





aP, 



aP, 



Fig. 5. The transmission scheme for W\. 



(i) 

The whole transmission proceeds across B blocks. In block i, the codeword includes the 



new message of Wn and W[ 2 for the current block and the "cell index" S\\ L> of the W[[ ±; hi 

(i) (i) 

block i — 1. User 2 always decodes the new message of W u and W} 2 at the end of block i and 



-(0 



(i-i) 



r(i-l) 



dirty paper code treating the previous block's cell index S u L> as known interference. At 
the end of block i, receiver Y 3 first decodes W^) , subtracts it out, and then dirty paper decodes 

(i) (i) 

W 2 , treating the other part of the new message, W u , as noise. Therefore, the interference 
corresponding to Sn is mitigated through dirty paper coding, boosting the rate of W 2 . 

In the first block, user 1 transmits a constant cell index Sn = 1, since there is no message 
Wn in the previous block; in the last block, user 1 transmits constant new message Wn = 1 
and Wi 2 = 1. In all other blocks, user 1 allocates (3P\ for W\ 2 , < f3 < 1; allocates (a — [3)P 1 
for Wn, P < ot < 1, and the remaining power (1 — a)Pi for Sn- Since Y 2 always knows Sn 
transmitted in the current block, the rate constraints at Y 2 are 



(t-ij 



Rn 
R12 
Rn + R12 



< 7 (^Pi) 

< 7(fsT 2 aPi) 



(148) 
(149) 
(150) 



Receiver Y\ also decodes W\ 2 first, subtracts it out, then decodes Sn- The corresponding rate 
constraints for reliable decoding are respectively 



Rn < 7 
Ro < 7 



[1-P)P 1 + 1 
(l-a)P 1 



(151) 



(152) 



l + (a-/3)Px) 

After this, Yi intersects the codewords of Wn in bin Sn with the ambiguity set [20] of Wn 
in the previous block to find the unique codeword Wn. The uniqueness is guaranteed if 

Rn < 7((« - P)Pi) + Ro (153) 
Combine (11521) and (11531) . we have 

Rn < -y((l-P)Pi) (154) 
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The rate constraints at Yi are 



R - * ^, l + ^-gp 1+ P 2 ) (155) 
R-2 < - [ : , ) (156) 



1 + 6 2 (a -/3)Piy 

which are the results of sequentially decoding W\ 2 and W 2 . For Pi = R u + R 12 , apply Fourier- 
Motzkin elimination on (|148I) - (|156L we obtain the region 7£ 3 . ■ 
Notice that while the encoding scheme mimics that for the relay channel [20], this is for a 
different purpose. The reason is that the new message in each block is required to be decoded 
by Y 2 with a maximum rate j(K 2 aPi). In the case of K 2 a > 1, Y\ will not be able to decode 
this new message; the cell index transmitted in the next block is to ensure reliable decoding of 
the message by Y\. Thus decoding of W\ at Y\ is accomplished in two steps, much like the way 
decoding is done at the receiver for the classic three node relay channel: in block i — 1, the 
received signal Y\ allows the partition of message indices into 7((a — P)P\) subsets, thereby 
allowing the construction of the ambiguity set; in block i the cell index can be reliably decoded 
if (11521 ) is satisfied. Uniqueness of the message index as the intersection of the ambiguity set 
and the cell is guaranteed if (11531 ) is satisfied. In addition to facilitating the decoding of Wi at 
Y\, the cell index itself allows interference cancellation for the cognitive transceiver pair through 
dirty paper coding and decoding as it is known at the beginning of the each block for transmitter 
2. 

Some numerical examples are given in Figj6l We see from Figj6]that with different values of 
K, the subset relation between TZ 1 and 1Z S varies. To find out their precise relation, we only 
need to consider the corner points of the two regions as 7l\ is a convex hull of its corner points 
whereas 1Z 3 is a convex region. For region IZi, when R\ = C\, 



1 f l + b 2 P 1 + P 2 
R2 = - log — — . (157) 



2 ° V 1 + Pi 



For region TZ 3 , when i?x = C 1 , 



R 2 = J log I 1 + — — ^— - ] . (158) 



2 & V 1 + b 2 P 1 /K 2 
In order for IZi to be a subset of TZ^, we need 

1 + b 2 P 1 + P 2 



i + Pl ^ 1 + TT^iW 059) 

which yields 

That is, when K is large enough, 1Z 3 dominates 1Z\, i.e., the coding scheme where receiver 
2 needs to decode both users' messages, which is capacity achieving for the classic ZIC with 
strong interference, is no longer optimal here. However, when K is small enough, especially 
when K is near 1, 1Z\ will dominate 71%, thus the cognitive link between the two users appears 
to yield no rate gain for the proposed encoding scheme. 
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The reason why 1Z\ can sometimes outperform 1Z 3 is that we apply sequential decoding at 
receiver 2, i.e., Y 3 decodes part of user l's new message (W12) first, then decodes W 2 . To improve 
the rate region, we can apply simultaneous decoding for W12 and W 2 as in the multiple access 
channel, which leads to the following constraints at receiver 2: 

R12 < I(W 12 ;Y 3 U 2 ) (161) 

R2 < I(U 2 ;Y 3 W 12 )-I(U 2 ;S n ) (162) 

R12 + R2 < I(U 2 W 12 ;Y 3 )-I(U 2 ;S n ) (163) 

where W\ 2 is part of W\ to be decoded by Y 3 ; Sn is the cell index of the message W\\, which 
is the other part of W\, U 2 is an auxiliary variable for dirty paper coding W 2 against Sn. To 
evaluate (fT6TT)-(fl63l. let W 12 ~ ^(0,^), S u ~ N(0, (1 - a)P x ), U 2 = X 2 + fiS u , where 
X 2 ~ iV(0, P 2 ) and ji is a deterministic real number. Thus, the right hand side of (I161I) - (I163I) 
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can be evaluated as 

, 1, ( (g + ^Pi)(P 2 + b 2 P, + 1) - (P 2 + ybaPtf \ 

U 2 ° g V(P 2 + /i 2 aPi)(P 2 + £> 2 M + 1) - (P 2 + /i6«P 1 ) 2 y' ^ ; 

t= h ( p 2 (p 2 + & 2 M + i) \ 6 , 

2 ° g V(P 2 + /i 2 aPi)(P 2 + 6 2 M + 1) - (P 2 + /ifePOV 

, 1, / P 2 (P 2 + fe 2 P 1 + l) \ 

U 2 ° g V(P 2 + ^aP x ){P 2 + 6 2 M + 1) - (P 2 + /ifoaPx) 2 ;' 1 ) 

Plugging (I164l) - (|166l) into (I161I) - (I163I) . we can define a new region, 1Z 4 , based on the idea of 



simultaneous decoding at receiver 2: 








Pi 


< 


7 (A- 2 aPi) 


(167) 


Pi 


< 


l(Pi) 


(168) 


Pi 


< 


1 {K\a-P)P 1 )+ 1 {pP l ) 


(169) 


Pi 


< 


1 {K 2 {a-(3)P 1 )+C 1 


(170) 


Pi 


< 


7 ((l-/3)Pi) + Ci 


(171) 


P 2 


< 




(172) 


Pi + P 2 


< 


1 (K 2 (a-P)P 1 )+( 3 


(173) 


Pi + P 2 


< 


7((l-/?)Pi) + Cs 


(174) 



for all < (3 < a < 1, — oo </i<oo, a + a = 1 and (3 + (3 = 1. 

Theorem 7: Region 1Z 4 is achievable for the cognitive ZIC. 
Comparison of IZi, 71% and 1Z 4 is given in FigjTJ It can be seen that for all values of K, is 
always the superset of both 1Z\ and 1Z 3 . 

It is worth noting that the two achievable regions IZi and 1Z 3 have a common corner point 

/ b 2 P \ 

fli = 7 r4 ),R2 = C 2 . (175) 



\l + P 2 y 

It is conjectured that for the classic ZIC, this is indeed the corner point of the capacity region 
[21], [22]. It is not clear whether the existence of the cognitive link may extend this corner point 
using some other coding schemes for finite K. 

3) b 2 < 1: For the weak interference case, we only know the sum rate capacity of the classic 
ZIC achieved at the corner point 

Pi = Ci, P 2 = 7 ( z P " n ) ■ (176) 



l + 6 2 Pi 

The other corner point of the known achievable region for the ZIC is described in (11751) . 

Let us define IZ5 as the Han-Kobayashi region [6] with Q = and Gaussian inputs for the 
classical ZIC. Then, after Fourier-Motzkin elimination, and removing redundant inequalities due 
to b < 1, 7^5 can be expressed by 

ft s ^^Att^ttt) (177 > 

V 1 + b 2 aP 1 + P 2 J 

ft s Ar^kp) <i78) 
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(a) 



P 1= P 2 =6, K=3, b=1.5 



1.5r 



(b) 



region 1 
-region 4 
-region 3 



0.5 1 1.5 

R 1 

(C) 

Fig. 7. Comparison of Hi, 1Z 3 and Ua. (a) Pi = P 2 = 6, K = 1.5,6 = 1.5. (b) Pi = P 2 = 6, K = 2, b = 1.5. (c) 
Pi = P 2 = 6, K = 3,6 = 1.5. 



for a G [0, 1]. For the cognitive ZIC with weak interference, the regions TZ 3 and 7^ 4 are still 
achievable. We can compare these three regions for different values of K, as plotted in FigJHl 

When K > 1, TZ 3 and IZ4 are the same and they outperform the HK region. 

When K = 1, regions 7£ 3 and IZ4 are indistinguishable from 7^ 5 . In fact, we can prove that 
1Z 3 is indeed inequivalent to 1Z 5 for b < 1 and K = 1. 

Lemma 2: 1Z 3 is equivalent to 7?.5 for b < 1 and if = 1. 

Proof: Since if = 1, by removing redundant constraints, 1Z 3 becomes 

fl, < 7 (aP0 (179) 
ft < 7((a-W) + 7( 1 + t , (1 ^ fi + ft ) 080) 

ft ^( l +t »(a- W ) <181) 
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(C) 



Fig. 8. Comparison of Us, TZ 5 and TZ 5 . (a) Pi = P 2 = 6, K = 2, b = 0.6. (b) Pi = P 2 = 6, if = 1, b = 0.6. (c) 
Pi = P 2 = 6, K = 0.9, 6 = 0.6. 



We can easily verify that since b < 1, for fixed a, the right hand side of (11801) is a decreasing 
function of /?. Thus, when j3 — 0, (| 1 801) reaches its maximum value 7(ctPi). Therefore, (I179I) is 
redundant and can be removed. Now, for the region defined by (I180I) - (I181I) . we can easily verify 
that for fixed /3, the region increases with a. Thus, the optimal operating point is for a = 1, i.e., 
transmitter 1 uses all its power, which is intuitively true for b < 1. By setting a = 1, (I180I) - (I181I) 
reduces to 1Z 5 . ■ 
When K < 1, 1Z 3 and IZ4 are still the same, and they are outperformed by the HK region. 
It is clear that, when K < 1, the idea of utilizing the cognitive link and applying dirty paper 
coding to boost R 2 is strictly suboptimal for the proposed coding scheme. Again, it is not clear 
if there is any other coding scheme that can improve the rate region by utilizing the cooperating 
link when K < 1. 
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C. Capacity Outer Bounds 

Besides the trivial outer bound 1Z 2 mentioned above, in this section, we propose a nontrivial 
outer bound to the capacity region of the cognitive ZIC for the case b < 1, and discuss some 
interesting implications from this result. Before presenting the outer bound, let us first introduce 
the following lemma. 

Lemma 3: If b < 1, the capacity region of the cognitive ZIC (|131I) - (I133I) is the same as the 
cognitive ZIC given below: 

Y[ = X x + Z x (182) 
Y 2 = KX X + Z 2 (183) 
Kj' = bY^ + X 2 + Z 3 (184) 

where Z 3 ~ N(0, 1 — b 2 ) is independent of all the other random variables. Thus, given X 2 , 

x x =*► y; => y 3 ' (185) 

forms a Markov chain. 

Proof: Since Y\ does not cooperate with Y 2 , Y 3 , the capacity region of the cognitive ZIC 
only depends on the marginal distributions p(yi\xi, x 2 ) and p(y 2 , 2/3 x 2 ). Further, since Z\, 
Z 2 and_Z 3 in the original model (I131I) - (I133I) are independent, in the modified channel, Z 2 and 
bZ\ + Z 3 are also independent. Therefore, 

P(y^ VsW, x 2 ) = p(y 2 , y 3 \x!, x 2 ). (186) 

Therefore, the capacity region of the modified channel is the same as the original channel, and 
the Markov chain (11851) follows automatically. ■ 
With the lemma above, we are ready to derive our outer bound described in the following 
theorem. 

Theorem 8: Define 1Z Q to be the union of all nonnegative rate pairs (Ri, R 2 ) satisfying 

R, < HX^YMlUXt) (187) 
R2 < I(UX 2 ;Y 3 ) (188) 
for all joint distributions that factor as 

p(u)p(x 1 x 2 \u)p(y 1 y2y3\xix 2 ). (189) 
Then 1Z is a capacity outer bound for the cognitive ZIC. 
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Proof: Define U, t = (y/ -1 ,^ -1 , W 2 ,X l f l ), and we have 

nRi = H(W 1 \W 2 ) (190) 

= I(W 1 ;Y 1 n \W 2 ) + H(W 1 \Y 1 n ,W 2 ) (191) 

< I{W 1 -Y?\W 2 ) + n6 1 (192) 

< I(W 1 ;Y 1 n Y 2 n \W 2 ) + ne 1 (193) 

n 

= ^2i(w l ;Y li Y 2i \Yt 1 Yt 1 w 2 )+ne 1 ( 194 ) 

i=l 
n 

= J2 I ( W ^ Y ^\ Y t lY t 1 W2X t 2 )+ne 1 (195) 



i=l 



= ^/(Xx^y^l^X^+nex (196) 

(11921) is due to Fano's inequality; (11951) is because the codeword X 2i is a function of and 
Y 2 ~ l as stated in (11351) ; (11961) is due to the memoryless channel model. 

nR 2 = H{W 2 ) = I(W 2 ;Y 3 n ) + H(W 2 \Y 3 n ) (197) 

< I(W 2 ;Y 3 n )+ne 2 (198) 

n 

= J2 I ( W ^ Y ^ Y 3~ 1 )+ ne ^ ( 199 ) 

i=l 
n 

= ^{/i(F3^r 1 )-M^|^r 1 W / 2)}+ne 2 (200) 

i=l 
n 

< ^{/ i (F 3 ,)-M>3^r 1 W / 2^)}+ne 2 (201) 

i=l 
n 

< ^{^(^-^(Fs^r'^X^I+nea (202) 
i=i 

n 

< J2{h(Y 3i )-h(Y 3l \U i X 2i )} + ne 2 (203) 



i=l 
it 



= ^J(C/iX 2i ;y 3 i)+^ 2 (204) 
i=i 

(12021) follows from Lemma [3l When b < 1, the capacity region of the cognitive ZIC is equivalent 
to the cognitive ZIC such that given X 2 , 

X 1 ^Y l ^ Y 3 . (205) 

Therefore it suffices to establish the outer bound for the cognitive ZIC satisfying (12051) . Due 
to (12051) , conditioning on (X^ -1 , Y"/ -1 ), the random vector Y 3 l_1 is independent of all other 
variables, including Y 3i . Thus, given X\,W 2 , 

Y 3l =s> Yr 1 => Yt 1 . (206) 
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Hence, 

h^\Yt x W 2 X^ > hiY^Yt^Xi). (207) 

Thus, (12021) follows. 

Now we introduce the time sharing random variable / to be independent of all other variables 
and uniformly distributed over {1, 2, n}. Define U = (Ui, I), X\ = Xu, X 2 = X 2 i, Y\ = Yu, 
Y 2 = Y 2 i and Y 3 = Y 3 j. Then, we have 

n 

nRi < J2 I ( X ^ Y ^\ U i X ^ +ne ^ < 208 ) 

i=i 

= nI(X 1I ;Y 1I Y 2I \U I X 2I I)+ne 1 (209) 

= nI(X 1 ;Y 1 Y 2 \UX 2 )+ne 1 (210) 

n 

nR 2 < ^J(C/ i X 2i ;y 3 i)+ne 2 (211) 

= nI(U I X 2I ;Y 3I \I)+ne 2 (212) 
< nI(IUjX 2I ;Y 3I )+ne 2 (213) 
= nI(UX 2 ;Y 3 ) + ne 2 (214) 

This establishes (|187l) - (1188l) but it requires Y 3 satisfy Markov chain (12051) . i.e., the noise Z 3 = 
bZi + Z 3 as in Lemma [3] However, due to the special form of (I187I) - (I188I) . we now show that 
this outer bound can be equivalently evaluated by assuming Z 3 to be independent of Z\ as 
in the original channel model. According to the channel model and the Markov chain (11891 ), 
(U, Xi,X 2 ) are independent of all the noises Zi, Z 2 and Z 3 . Therefore, to compute (11881) . 

I(UX 2 ;Y 3 ) = h(bX 1 +X 2 + Z 3 )-h(bX 1 + Z 3 \UX 2 ) (215) 

= h(bX 1 +X 2 + Z 3 )-h(b(X 1 \UX 2 )+Z 3 ) (216) 

Thus, any value that I(UX 2 ;Y 3 ) can achieve with Z 3 = bZ 1 + Z 3 can also be achieved with 
Z 3 independent of Z\. Therefore, The relaxation of Z 3 to its original model will yield the same 
outer bound. This proves Theorem [8] ■ 

To recap, the proof of Theorem[8]is accomplished in two steps. The first step utilizes Lemma|3] 
and establishes the outer bound for the equivalent channel satisfying the Markov chain conditions 
12051 In the second step, we prove that the the outer bound can be equivalently evaluated using 
the original channel model. Theorem [8] is valid for all cognitive ZIC as long as b < 1. This 
outer bound is analogous to the capacity region of a degraded broadcast channel where receiver 
Y 3 sees a degraded channel compared with that of (Y 1 ,Y 2 ). 

Next, we derive another outer bound for the specific case where b < 1 and K > 1. Before 
that, we introduce another lemma. 

Lemma 4: If K > 1, the capacity region of the cognitive ZIC (I131I) - (I133I) is the same as the 
cognitive ZIC given below: 

Yi = ^Y 2 + Z, (217) 

Y 2 = KX ± + Z 2 (218) 
Y 3 = bX 1 +X 2 + Z 3 (219) 
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where Z\ ~ N(0, 1 — j^) is independent of all the other random variables. Thus, 

X x => Y 2 => y x . (220) 

Further, for all random variable [/ such that [/ =>• (Xl, X 2 ) =>■ (Yi, Y 2 , Y 3 ), 

X X ^{U,X 2 ,Y 2 )^Y X . (221) 
Proof: The argument is similar to that of Lemma |3j Since Y\ does not cooperate with Y 2 
or Y 3 , the capacity region only depends on p(yi\xix 2 ) and p(y 2 ,y 3 \xi,x 2 ). Therefore, making 
the noise at Y\ to be correlated with that of Y 2 will have no effect on the capacity region. Thus, 
( 12201 ) holds. Furthermore, since Z x is independent of all other variables, (|221l) also holds. ■ 
When K > 1, according to Lemma HI we only need to consider the cognitive ZIC such that 
(12211) is satisfied. Since b < 1 and due to the fact that Theorem [8] holds for the original cognitive 
ZIC channel model, the outer bound (I187I) - (I188I) is still an outer bound for the system defined 
in Lemma HI For all U under condition (11891) . due to ()221|) . 

I{X 1 -Y 1 \UX 2 Y 2 ) = 0. (222) 

Thus, we can rewrite the outer bound 1Z Q as 

Rt < I(X X] Y 2 \UX 2 ) (223) 

R2 < I(UX 2 ;Y 3 ). (224) 

Next, we give the second outer bound in the theorem below. 

Theorem 9: If b < 1 and K > 1, an outer bound to the capacity region of the cognitive ZIC 
is the union of all nonnegative rate pairs (R U R 2 ) satisfying 

Ri < Cx (225) 
R 2 < C 2 (226) 
Ri < 7(^ 2 aPi) (227) 



^ ^ H — i+iMp! — ) (228) 

for < a < 1 and a + a = 1. 

Proo/- (12251) and (j226j] are trivial outer bounds. (12271) and (12281) are derived from (12231) 
and (1224)) . respectively. Consider (12231) . 

/i(F 2 |?7X 2 ) = MX*! + Z 2 \UX 2 ) (229) 

< /i(M! + Z 2 ) (230) 

< -log(27re(l + lir 2 Pi)) (231) 



On the other hand, 



2 

h(Y 2 \UX 2 ) > hiY^UXtX^ (232) 

1 
2 



/i(Z 2 ) = J log(27re) (233) 



Without loss of generality, we set 



1 



h(Y 2 \UX 2 ) = ~ log(27re(l + K 2 aP 1 )) (234) 
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where a € [0, 1]. Thus, bound (|223l) becomes 

R x < ilog(27re(l + ir 2 aPi)). (235) 

By Lemma 1 of [23], 

h{Y 2 \UX 2 ) < h{KX 1 + Z 2 \X 2 ) (236) 

< h(KX* + Z 2 \X*) (237) 

= ilog(27re(l + ir 2 Var(X*|X*))) (238) 
2 

where X]* and X£ are Gaussian distributed variables with the same covariance matrix with that 
of Xi and X 2 . Combining (12341) and (|238l) . we obtain 

Var(X*|X*) > aPi (239) 

Since, 

Var(X*|X*) = E[(X*) 2 ] - P[(P[X*|X*]) 2 ], (240) 
Combined with (1239k we obtain 

E[(E[Xl\X* 2 ]) 2 } < aP x . (241) 

Thus, 

E{X X X 2 ) = £(X*X 2 *) (242) 

< {E[{E[Xl\X* 2 }f]E[{X;f}Y (243) 



< \laP x P 2 . (244) 

Next we consider (|224)> . Since K > 1 and 6 < 1, given X 2 , Y3 is a degraded version of Y 2 . By 
the entropy power inequality, 

22h(Y 3 \UX2) > 22h(±Y 2 \UX 2 ) + 2 2h(^') (245) 

= |W"l"*0 + 2?re(1 _ * ) (246) 

=-^2vre(l + K 2 aP x ) + 2ne(l - (247) 

=27re(l + 6 2 aPi) (248) 



Therefore, 



Thus, (12241) becomes 



M>sl^2) > \ log(27re(l + 6 2 aPx)) (249) 



I{UX 2 ; Y 3 )=h(Y 3 ) - h(Y 3 \UX 2 ) (250) 



1 fb 2 P 1 + P 2 + 2bJaP x P 2 + 1 ' . 
<-log ; , 9 „ (251) 



2 & V 1 + 6 2 aPi 
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This completes the proof of Theorem [9J ■ 
Corollary 1: If K < 1 and b < 1, then (Ci, 7( 1+ ^I P )) is the corner point of the capacity 
region for the cognitive Z channel. 

Proof: The achievability of this point is trivial, as this is indeed the sum-rate capacity of 
the classical ZIC, i.e., one can achieve this point in the absence of the cooperating link. 

For the converse part, if b < 1, when K = 1 and R\ = G\, according to Theorem |9l 
Ri < 7( t+fp )• Thus, this corner point is on the boundary of the capacity region of the cognitive 
ZIC when K — 1. Since the capacity outer bound for the case with K — 1 is also an outer 
bound for the case with K < 1 if all other parameters remain the same, this is also a corner 
point of the capacity region for all K < 1. ■ 
That is to say, when the interference is weak (b < 1) and the cooperating link is weak (K < 1), 
the cooperating link becomes useless when user 1 is transmitting at its maximum rate. While this 
does not imply that the entire capacity region will not be affected by the cooperating link, this 
corner point is particularly important in practice: it is often desirable in a cognitive radio system 
with primary-secondary user pairs that the primary user's rate is not affected by the interference 
of the secondary user. We note that in the absence of the cooperating link, this is also the sum- 
rate capacity corner point. However, no such statement can be made for the cognitive Z channel 
as the slope of the outer bound at this corner point is not necessarily smaller than 45°. The 
comparison of the outer bound 1Z a and the inner bounds are given in Fig. |9j Note that 7^ 4 and 
coincide with each other in (a) when K = 1 while 71$ outperforms 1Z$ in (b) when K > 1. 
Also, when K = 1, the optimal corner point (Ci,7( 1+ ^ p )) is shown in (a). 




IV. Conclusion and Discussion 

This paper studied the interference channel with one cognitive transmitter (ICOCT), from both 
the noncausal and causal perspectives. For the noncausal ICOCT (or interference channel with 
degraded message sets), we proposed a new achievable rate region which generalizes existing 
results reported in the literature. The proposed coding scheme leads to a rate region that reduces to 
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Marton's achievable rate region for the general broadcast channels in the absence of the primary 
transmitter. This proposed achievable region, together with a new outer bound, establishes the 
capacity region of a class of semi-deterministic IC-DMS. 

The causal ICOCT, which is a special case of interference channels with generalized feedback, 
imposes causality constraint on the way the cognitive transmitter can cooperate with the primary 
user. Motivated by practical constraint on the so-called interference temperature in the spectrum 
sharing cognitive radio system, we focus on the Gaussin Z interference channel (ZIC) in which 
the interference link from the cognitive transmitter and the primary receiver is negligible. Both 
capacity inner bounds and outer bounds are proposed for the cognitive Gaussian ZIC. The 
capacity bounds established some intuitive results with regard to the usefulness of the cognitive 
capability. In general, when the feedback link is weak, it is generally not useful to utilize the 
cognitive capability, as far as the capacity region is concerned. 



Appendix 

A. Proof of Theorem [2] 

Proof: Codebook generation: Generate 2 nRl ° independent and identically distributed (i.i.d.) 

codewords Uio(jio), jio = !>■"•> 2 nRl °, according to YYi=iP( u w,i)- For each codeword Uio(jio), 
generate 2 nRl1 i.i.d. codewords u n (j n ,j 10 ), j n = 1, • • • , 2 nRl \ according to n<=iK u n,il u io,i)- 
For each pair of (un, Uio), generate one codeword xi(jn, j w ) according to YYi=iP( x ^A u ^,i^ u w,i) 
For each codeword ui (jio), also generate 2 nL20 i.i.d. codewords v 20 (/ 2 o, jio), ho = 1, • • • , 2 nZ,2 °, 
according to Yl7=iP( v 20,i\ u io,i) an d randomly place them into 2 ni?2 ° bins. For each codeword 
pair (v 20 (/ 2 o, jio),u 10 (ji )), generate 2 nLl1 i.i.d. codewords v n (/ n , Z 20 , jio), hi = 1, • • ■ , 2 nLl1 , 
according to Yli=i P{ v u,i \ v 2o,i, «io,i) an d randomly place them into 2 nRl1 bins. For each codeword 
pair (v 20 (/ 20 , jio),Ui (jio)), generate 2 nL22 i.i.d. codewords v 22 (7 22 , l 20 , jio), I22 = 1, • • ■ , 2 nL22 , 
according to Y\d=iP( v 22,i\ v 2o,i, Wio,») an d randomly place them into 2 nR22 bins. For each set 
(v 22 , v 20 , vn,un,uio), generate one codeword x 2 (Z 22 , l 20 , hi, jn, jio) according to 

n"=l P(x2,i\v 2 2,i, V2D,i, «10,i)- 

Encoding: For user 1 to send message (jn, jio), it simply transmits the codeword xx(jn, j 10 ). 
Suppose user 2 wants to send message (j 22 , j 2 o), encoder 2 first looks into bin j 20 for codeword 
v 2 o(ko, jio) such that 

(v 2 o(^20, jio),UuO'ii, jio),u 10 (jio)) e T e (V 20 ,Un,U 10 ) (252) 

where T e (-) denotes jointly typical set. After it finds v 20 (/ 2 o, jio), it looks for a codeword 
v 22 (/ 22 ,/ 20 , jio) in bin j 22 and a codeword v u (l n , £ 20 , jio) in bin j n such that 

(v 22 (/ 22 ,/ 20 , jio), vn(/n,/ 20 , jio),un(jn, jio), v 20 (/ 20 , jio),ui (jio)) G T e {V22V n U n V2oUi$L53) 

If there are more than one such codewords, pick the one with the smallest index; if there is no 
such codeword, declare an error. Then, user 2 sends x 2 (7 22 , Z 20 , In, jn, jio)- The diagram of the 
encoding scheme is illustrated in Fig. [2] 

Decoding: Given yi, receiver 1 looks for all sequences vn, un, ui , v 20 such that 

(vn, u n , uio, v 20 , yi) G T^VuUnUxoVzoYx) (254) 

If all the codewords vu have the same bin indices jn, all u n and u 10 have the same message 

indices j n and ji respectively, and if j n = j n , we declare jn = jn, jio = jio; otherwise, 
declare an error. 
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Given y 2 , receiver 2 looks for all sequences v 22 , v 20 , u 10 such that 

(v 22 , v 20 , uio, y 2 ) G T e (V 22 V 20 U w Y 2 ) (255) 

If all the codewords v 22 and v 20 have the same bin indices j 22 and j 20 respectively, we declare 

322 = 322, J20 = 320, otherwise, declare an error. 

Error analysis: By the symmetry of random code generation, without loss of generality, 

we assume the messages (j n , j 1Q , j 22 , j 20 ) = (1,1,1,1) are sent. Let P e , enc2 , P e ,ded, P e ,dec2 
denote the error probabilities at encoder 2, decoder 1 and decoder 2 respectively. Denote the 
codeword v 20 (Z 20 , jio) as v 20 (j 2 o, ho, jio), where j 20 is its bin index and ho is its index within 
the bin. Similarly, we denote vn(Zn, ho,jio) and v 22 (/ 22 , / 20 , j w ) as v n (j n , hi, jw, ho, jw) 
and v 22 (j 22 ,/c 22 ,j 20 , ho, jw) respectively. 

1) Error occurs at encoder 2 when one or both of the following events occur. 

Ei : there is no v 20 such that (12521 ) holds. 

E 2 : there is no pair (v 22 , vn) such that (12531) holds. 

where event E\ can be further divided into two sub-events: 

En ■ uii(jii,jio) and UioO'io) are not jointly typical. 

Ei 2 : With un(jn,jio) and ui (jio) jointly typical, there is no v 20 that satisfies (12521) . 

(257) 

According to the code book generation, it is obvious that P(En) < e. For P(Ei 2 ), we have 

P{Ei 2 ) = (l-?[MU 20) l) ) u n (l,l),u4l))6r f (MiM) 2 " (l2r8201 (258) 

< (1 - 2 _ " (/(y2o; ' 7ll|c/lo)+e) ) 2 ™ (L20 ~' R2o) (259) 

< exp(-2 n(L20 ~ R20 ~ /(y2o; ' 7ll|C7lo)_e) ) (260) 

So, (|43l) guarantees P(Ei) — > as n — > oo. 

Event E 2 can be divided into the following three sub-events: 

E 2 i : There is no codeword v n such that (v 11; u n , v 20 , u 10 ) G ^(ViiC/iiV^oC/io)- 

E 22 : There is no codeword v 22 such that (v 22 , u n , v 20 , Ui ) G T e (V 22 U uV 2Q U w ). (261) 

E 23 : Provided E 2X and E 22 occur, there is no pair (v 22 , vu) such that (12531) holds. 

Following similar derivations as for event Ei 2 , the error probability for events E 2 i and E 22 will 
be arbitrarily small as n — > oo if (l44l) and (1451) hold respectively. By using the second moment 
method as in [14], one can also show that P(E 23 ) — > as n — > oo if (l46l) holds. Since 

P e , enc2 = P{Ei U E 2 } < P(Ei) + P(E 2 ) (262) 

(|43l and (|46l) ensure P e ,enc2 -> as n ^ oo. 

2) Error occurs at decoder 1 if 

E 3 : The transmitted (ui (l), v 20 (l, ho, 1), Vn(l, hi, 1, ^20, 1), Uu(l, 1)) do n ot sa tisfy (12541) . 
Ea- (n 10 (ji Q ),v 20 (j 2 o,k' 20 Jio),Vi 1 (j 1 i,k[iJ 20 ,k 20 J 10 ),Ui 1 (ji 1 , j 10 )) satisfy d254]) 
where (j u , j 10 ) ^ (1, 1). 
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Let A(j 10 ,j 20 , k 2Q ) Jii? ^n) denote the event E4. We have 
Pe,deci < P{E 3 UE i }<P{E 3 )+P{E 4 ) (263) 

< e+ P{A{jio,ho,k' 20 ,ji 1 ,k' u )) (264) 

(iioj2oiii)7K m ).*4>> fc ii 

< e+ ^ P(A(jio,320,k' 20 ,j n ,k' n )) (265) 

jlOJ L l,j20,k' 20 ,jll,k' 11 

+ Yl P(A(l,j 20 ,k w ,j u ,k' u ))+ P(A(l,l,k' 20 ,j u ,k' u )l266) 

Take P(A(1, 1, k' 20 ,j n , k' n )) for example, 

P(A(1, 1,4,^1,0) (26V) 
= 2J p(uioV2o)p(uii|uio)p(vii|v 2 oUio)p(yi|uioV2o) (268) 

(vii,v 2 o,uii,uio,yi)eT E 

< 2- n [ H (^io y 2o)+H(^ii|^io)+H(y 11 |y 2 oLf 1 o)+^(yi|y2o^io)-H(^ioV 2 oViii/iin)-e] (269) 

< 2- n [ / ( l/ n; y i y 2ol l/ io)+ / ( v ii; Y i c/ iil y 2oC/io)] (270) 

So, 

p d 1 < e _|_ 2~ n [ / (^ llf/lll/2oC7lo;yi )~( ill+ - L20 +- Rl °)~ e ] (271) 
+ 2 -™[ / ( v 'ii c/ ii y 2o;n|c/io)-(Lii+i2o)-e] + 2 -"[-r(^ii;nv2o|c/io)+/(Vii i y 1 !7i 1 |c/ioV 2 o)-iii- ( ^ 7 2) 



e can be made arbitrarily small by letting n — ► 00. The conditions (I47l)-(|49l) guarantee that 

-P e ,d ec i as n -> 00. 

3) The error at decoder 2 can be similarly analyzed and conditions (|50l)-(l52l) will ensure that 

Pe,dec2 — > as 72 -> OO. ■ 
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